Representing and Evaluating Electronic Contracts with Normative Markov Decision Processes

نویسندگان

  • Moser Silva Fagundes
  • Sascha Ossowski
  • Michael Luck
  • Simon Miles
چکیده

This position paper summarizes the contributions resulting from the short term scientific mission (STSM) of the first author, from University Rey Juan Carlos, to the Kings College London. During this scientific mission, we have studied the impact of norms on the sequential decision making of rational agents, and how they can be modelled and quantitatively assessed. For this purpose, we put forward a framework based on Markov Decision Processes that allows for explicitly representing norms and sanctions. In order to illustrate the usage of the framework, we model an example in a simulated aerospace aftermarket ruled by electronic contracts in terms of norms and sanctions, and present algorithms for reasoning about it.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Using Normative Markov Decision Processes for evaluating electronic contracts

Before signing electronic contracts, a rational agent should estimate the expected utilities of these contracts and calculate the violation risks related to them. In order to perform such pre-signing procedures, this agent has to be capable of computing a policy taking into account the norms and sanctions in the contracts. In relation to this, the contribution of this work is threefold. First, ...

متن کامل

Accelerated decomposition techniques for large discounted Markov decision processes

Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...

متن کامل

The Advisor-POMDP: A Principled Approach to Trust through Reputation in Electronic Markets

This paper examines approaches to representing uncertainty in reputation systems for electronic markets with the aim of constructing a decision theoretic framework for collecting information about selling agents and making purchase decisions in the context of a social reputation system. A selection of approaches to representing reputation using Dempster-Shafter Theory and Bayesian probability a...

متن کامل

Reasoning under Uncertainty in Social Reputation Systems: The Advisor-POMDP

This paper examines approaches to representing uncertainty in reputation systems for electronic markets with the aim of constructing a decision theoretic framework for collecting information about selling agents and making purchase decisions in the context of a social reputation system. A selection of approaches to representing reputation using Dempster-Shafter Theory and Bayesian probability a...

متن کامل

Complexity Issues in Markov Decision Processes

We survey the complexity of computational problems about Markov decision processes: evaluating policies , nding good and best policies, approximating best policies, and related decision problems.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012